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Black  Core 


How  traffic  engineering  can  soive 
the  probiem  of  circnit  satnration 


By  CPT  Felix  Torres 

The  dynamics  of  U.S.  military  communications 
in  the  Afghanistan  Theater  has  changed  dramati¬ 
cally  over  the  last  few  years. 

There  have  been  significant  upgrades  in  band¬ 
width  from  the  typical  8  Mbps  satellite  circuits 
to  10  Gbps  fiber  optic  metropolitan  area  network 
solutions.  The  capability  to  support  increased 
customer  requirements  and  efficiency  provided 
by  Internet  Protocol  based  transport  were  the 
initial  drivers  to  facilitate  a  migration  from  legacy 
Time  Division  Multiplexers  (e.g.  Promina)  to  the 
IP  based  infrastructure  found  in  the  Afghanistan 
Black  Core  Network  today. 

An  additional  advantage  of  leveraging  IP 
transport  is  the  ability  to  dynamically  provision 
bandwidth  to  all  traffic  traversing  the  network  as 
their  bandwidth  requirements  fluctuate. 

The  Black  Core  Network  was  introduced  into 
production  in  early  2010  and  modeled  after  the 
Defense  Information  System  Agency  backbone  in¬ 
frastructure.  The  BCN  in  Afghanistan  continues  to 
grow  and  mature  as  the  primary  method  of  trans¬ 
porting  secure  communications.  The  introduc- 

LoS  16Mbs  (Not  Used) 


Satellite  8Mbs  (Not  Used) 


tion  of  Multiprotocol  Label  Switching  to  the  BCN 
allowed  for  each  customer's  traffic  to  be  isolated 
into  its  own  virtual  circuit.  Separation  of  customer 
traffic  is  made  possible  by  maintaining  a  separate 
routing  table  on  the  BCN  for  each  virtual  circuit. 
Improvements  in  hardware  and  routing  protocols 
have  enabled  multiple  concurrent  means  of  trans¬ 
port  on  the  battlefield  that  previously  were  limited 
to  large  strategic  entities  such  as  DISA. 

In  certain  parts  of  Afghanistan,  mission  critical 
traffic  has  to  compete  for  bandwidth  on  congested 
links.  In  the  aggregate,  throughput  requirements 
exceeded  allocated  bandwidth. 

Even  though  there  are  other  paths  available  on 
the  BCN,  standard  routing  techniques  required  all 
traffic,  including  Secure  Internet  Protocol  Routing, 
Non-Secure  Internet  Protocol  Routing,  and  coali¬ 
tion  partner  networks  to  transit  through  a  single 
primary  path.  As  the  BCN  transport  system  grew 
to  include  additional  customers  outside  of  NIPR, 
SIPR  &  CX-1,  the  need  to  prioritize  traffic  based 
upon  operational  impact  began  to  emerge. 

Despite  the  fact  that  Black  Core  routing  al¬ 
lowed  for  the  dynamic  provisioning  of  bandwidth 
for  SIPR/ NIPR/ CX-1  based  on  need,  this  may  not 

be  enough  as  traffic  separa¬ 
tion  becomes  a  priority  as 
well. 

To  overcome  the  lim¬ 
itations  imposed  by  standard 
IP  routing  techniques,  net¬ 
work  engineers  in  Afghani¬ 
stan  began  employing  Multi 
Protocol  Label  Switching 
"Traffic  Engineering." 

Traffic  Engineering 
allows  for  the  routing  of  data 
across  multiple  transmission 
media  concurrently.  Where 
previously,  standard  routing 
protocol  may  only  allow  the 
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LoS  16Mbs 


SITE  B 


Fiber  155Mbs 


Satellite  8Mbs 


transmission  of  data  over 
a  single  fiber  path.  Traffic 
Engineering  can  enable  the 
transmission  of  data  across 
fiber  and  satellite  links  at 
the  same  time.  For  example, 
by  using  Traffic  Engineer¬ 
ing,  if  it  became  necessary, 
network  engineers  can  pro¬ 
vision  mission  critical  SIPR/ 

CX-1  over  low-latency  fiber 
paths  between  sites,  while 
directing  non-critical  NIPR 
over  high-latency  satellite 
links. 

The  BCN  uses  many 
different  modes  of  transmis¬ 
sion  including  fiber  optic, 
commercial  and  military 
Line  of  Sight  radios  and  dif¬ 
ferent  bands  of  satellite  terminals.  Figure  1  shows 
how  normal  routing  would  occur  for  NIPR,  SIPR 
and  CX-1  traffic. 

MPLS-TE  enables  the  use  of  all  links  between 
a  Forward  Operating  Base  or  Combat  Outpost  and 
its  hub.  For  example,  MPLS-TE  makes  it  possible  to 
concurrently  use  a  155Mbps  fiber  path,  an  8Mbps 
satellite  link  and  a  16Mbps  Line  of  Sight  shot 
between  Site  A  to  the  regional  hub  at  Site  B.  This 
is  accomplished  by  routing  traffic  for  one  enclave 
(e.g.  SIPR)  over  a  commercial  LoS  link,  traffic  for 
another  enclave  (e.g.  CX-1)  over  a  fiber  optic  link 
and  traffic  for  another  enclave  (e.g.  NIPR)  over  a 
commercial  satellite  link,  as  illustrated  in  Figure  2. 

This  results  in  a  substantial  return  on  invest¬ 
ment  by  allowing  operational  forces  to  take  ad¬ 
vantage  of  multiple  links  and  providing  failover 
in  outage  situations.  It  also  allows  mission  critical 


Requirement:  160Mbs 
Available  Throughput:  179Mbs 
Deficit:  0 

traffic  to  be  routed  over  higher  speed  links,  as  in 
the  example  above. 

The  Afghan  BCN  continues  to  evolve  in  its 
development  and  now  exists  at  over  70  sites  within 
the  Combined  Joint  Operation  Area  -Afghanistan. 
An  argument  could  be  made  that  the  ingenuity  of 
the  BCN  engineering  team  in  leveraging  technol¬ 
ogy  such  as  MPLS-TE  has  saved  the  Department 
of  Defense  countless  dollars  in  recurring  monthly 
service  provider  charges  and  capital  equipment 
expenditures  while  exemplifying  the  intelligent 
application  of  technology  to  solve  problems  on  the 
battle  field. 

CPT  (P)  Felix  Torres  is  the  Principal  Network  Engi¬ 
neer  /  Task  Force  236  -  Afghanistan  Officer  in  Charge 
for  the  335TH  Signal  Command  (Theater)  (Provisional) 
stationed  in  Kabul,  Afghanistan. 


Acronym  QuickScan 


BCN  -  Black  Core  Network 
CENTRIXS-ISAF,  CX-I  - 
Combined  Enterprise  Regional 
Information  Exchange  System  - 
International  Security  Assistance 
Force 

COP  -  Combat  Outpost 


DISA  -  Defense  Information 
System  Agency 

FOB  -  Forward  Operating  Base 

Gbps  -  Gig  bits  per  second 

IP  -  Internet  Protocol 

LoS  -  Line  of  Sight 

Mbps  -  Mega  bits  per  second 


MPLS  -  Multiprotocol  Label 
Switching 

MPLS-TE  -  Multi  Protocol  Label 

Switching  Traffic  Engineering 

NIPR  -  Non-Secure  Internet 

Protocol  Routing 

SIPR  -  Secure  Internet  Protocol 

Rouhng 
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